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Abstract 

The replicator dynamics of players choosing either mixed or pure strategies are 
usually regarded as equivalent, as long as strategies are played with identical fre- 
quencies. In this paper we show that a population of pure strategies can be invaded 
by mixed strategies in any two-player game with equilibrium coexistence upon the 
addition of an arbitrarily small amount of noise in the replication process. 
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The understanding of the spontaneous emergence of cooperation is central 
to uncover the origin of complex social organizations in populations of selfish 



genes. The general framework employed (Nowak(2006) ) supposes a population 
interacting in pairs by playing evolutionary games representing social dilem- 
mas. The individuals choose among a repertoire of behaviors and the outcome 
of these interactions affects their reproductive fitness. In the simplest case 
these individuals can be regarded as players of a game with two strategies 
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represented by a 2 x 2 payoff matrix. As the game is interactively played, indi- 
viduals with larger payoffs will thrive with larger reproductive fitnesses while 
those with worse performances will eventually perish. 



Recent experimental evidence (Kummerli et al. (2007)) suggests that the iter- 



ated Snowdrift Dilemma (SD) (Doebeli & Hauert(2005) ) may be more suitable 



for explaining the high levels of cooperation observed among unrelated human 
individuals than the more intensively studied iterated Prisoners' Dilemma. In 
a SD each player can in each turn either cooperate (C) or defect (D). The 
cooperative behavior by at least one individual yields a benefit b to both play- 
ers. If both individuals cooperate each one contributes c/2 to the total cost, 
otherwise the total cost c is payed by the cooperator alone. Mutual defection 
yields no benefit or cost to any player. 



The replicator dynamics (Hofbauer & Sigmund(1998) ) for the evolutionary 



SD game yields a simple prediction. If there are only cooperators in the pop- 
ulation, a defector will have the advantage and will invade. Similarly, in a 
population of defectors, a cooperator can also invade. A fixed point is reached 
when cooperators are observed with probability pc = 1 — c/ (2b — c). 

It is generally assumed that it makes no difference whether the population is 
composed by genes playing pure defective (D) or cooperative (C) strategies in a 
proportion defined by pc or by genes playing mixed strategies with probability 
of cooperating p c . Notice that a gene can play a mixed strategy either by 
creating individuals who play mixed strategies or by having a proportion of 
its carriers to behave as cooperators while the others behave as defectors. In 
other words an arbitrary population of pure strategists is thought to be stable 
against a population of mixed strategy players, given that the probability of 
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cooperating is tunned to be pc- 

In the following we will analyze the effect of a random drift on pure and 
mixed strategies playing games with equilibrium coexistence having the SD 
as a major example. 

[Fig. 1 about here.] 

Let us suppose a well-mixed population playing an evolutionary two-player 
game with strategies C and D and payoff matrix given by: 
/ \ 

a C'C a CD 



A 



Q>DC a DD 



with acc < a oc and clcd > o>dd, implying strategies that coexist at equilib- 
rium with cooperators at frequency: 



Pc = 1 - 



&CD — 0>DD 



Q>DD — &CC + a CD + &DC 



(2) 



Suppose this population to be composed of mixed strategists at frequency 
xm playing C with probability pc, pure defectors and pure cooperators at 
frequencies xd and Xc, respectively. 



The replicator dynamics is given by (Nowak(2006) ) 



Xn X 



a i^fa fj 



(3) 



where x a and f a are, respectively, the frequency and the payoff (or fitness) 
of type a players and / = J2 a x afa is their mean fitness. Considering that 
xm + xc + xd = 1, we can eliminate one of the three equations in (J3j) to write: 
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xc = (fc - Id) [(1 - Pc)(x c ~ x 2 c ) + Pcx c x D 
xd = (fc ~ Id) Pc(x d ~ x d) ~ (1 - Pc)x c x D 



(4) 



with 



fc — /d 



&cd — O-DD 
1 -pc 



[(1 - p c )xc - Pcx D ] 



(5) 



It can be easily verified that the dynamical system in ([5]) has a line of fixed 
points defined by xd = xc(l — Pc)/Pc- The linear stability of these fixed 
points can be studied by calculating the Jacobian matrix in the neighborhood 
of the line to find: 



J = ~(acD - a DD )x c 



( \ 

(l-Pc) -Pc 



\ 



(1-pc) PC 



(6) 



which has a stable eigen-direction V\ = (1, —1) with eigenvalue Ai = — (aoo — 
o>dd)xc and a degenerate eigen-direction v = (1, (1 —pc)/Pc)- As expected, 
this analysis reveals that a population composed by pure strategies at equi- 
librium and by mixed strategies is stable regardless of the frequency xm of 
mixed strategists. 

In figured] we represent this general picture in a simplex with special attention 
to the fact that stable eigenvalues depend on xq- 

[Fig. 2 about here.] 



To assess the behavior along the stable line we introduce a random perturba- 
tion as xd = x(l — Pc)/Pc + e > x c = x and xm = 1 — xq — id — e with e > 
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if x = and e < if x = pc to find: 



x ~ pc{acD - a DD )ex, (7) 

Let us now suppose that the replication of each and every one of the strate- 
gies is randomly influenced by global environmental changes. This may be 
represented by adding noise in the mapping of payoffs into fitnesses. To as- 
sess this scenario we replace the perturbation in ([7j) by a Wiener process as 



etdt = adWt (Oksendal(2000) ). We can then show that this component leads 
to a drift toward a population composed exclusively by mixed strategies (point 
xm in figure [1]). That can be seen by changing variables in (J7J) to write the 
following stochastic differential equation in Ito form: 

dlog(x) = adW t - ^a 2 dt, (8) 

where a = crpci^cD — o>dd)- We now consider an initial population with 
pure strategies and a positive, but very small, frequency of mixed strategies 
x ~ pc- Assuming very small fluctuations (a very small), equation (jSJ) yields 
the following approximation for the probability density for x: 

(log^ + |«V 2 



Pt{x) = — 7=exp 



2aH 



(9) 



that converges as t — > oo to Poo(x) = 5(x), to say, to populations concentrated 
around % = 1. In figure [2] we show a simulation for the replicator dynamics 
of the SD game with 6 = 4 and c = 2. The initial condition is set to be the 
evolutionary equilibrium with cooperators to be found at frequency pc and 
a single mixed strategy with probability pc of cooperating. As predicted, the 
population of pure strategies is led to extinction by mixed strategies. 
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The general picture that emerges can be described as follows. Suppose that 
the population has been brought to a rest point. From there, any change in 
the proportion of the mixed strategies that keeps the proportion of the pure 
strategies unaltered will not change the matching probabilities when the game 
is played and therefore, this will correspond to a perturbation along a stable 
eigen-direction, with no consequences other than the random change. 

A different scenario is observed if the ratio of the pure strategies is somehow 
altered. When that happens, matching probabilities will change to a point near 
the rest point. And, while the mixed strategy is still playing the evolutionary 
equilibrium answer to the game, the pure strategies are no longer doing that. 
This means that some of them might be better than average (those that have 
become rarer), while others will certainly be worse (the strategies that became 
more common). This will cause the system to move closer to the rest point, 
restoring the equilibrium, as expected in the basin of attraction. However, 
an important effect happens here. The mixed strategy was playing the best 
answer and therefore, its fitness becomes larger than the average until the 
equilibrium is restored, regardless of the direction of departure. This means 
that any time a drift that changes the relative proportions of pure strategies 
happens, the mixed strategy will increase its proportion. In the long run, it 
will slowly dominate the game and the drift will cause the extinction of all 
pure strategies. 

We emphasize that the conclusion above holds for any game with equilib- 
rium coexistence and we have used the SD case as an example. That means 
that any analysis of evolutionary processes or of the emergence of cooperation 
should also be performed without the supposition that strategies breed true. 
In the long run, mixed strategies will have a higher probability of survival and 
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this fact should be taken into consideration when evolutionary dynamics is 
considered. 
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Fig. 1. Simplex for a game with equilibrium coexistence, pure and, mixed strategies. 
The thick dashed line represents fixed points. Stable eigen-directions are represented 
by arrows with lengths proportional to the related eigenvalues. 
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Fig. 2. Simulation of the Snowdrift game with 6 = 4 and c = 2 starting with a 
population of pure strategy playing at the evolutionary equilibrium and one single 
mixed strategy. 
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